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1.2.3 Cardinality: Countable and Uncountable Sets 

Here we need to talk about cardinality of a set, which is basically the size of the set. The cardinality of a set is denoted by A . We first discuss 
cardinality for finite sets and then talk about infinite sets. 

Finite Sets: 

Consider a set A. If A has only a finite number of elements, its cardinality is simply the number of elements in A. For example, if 
A = { 2 , 4 , 6 , 8 , 10 }, then \A\ = 5 . Before discussing infinite sets, which is the main discussion of this section, we would like to talk 
about a very useful rule: the inclusion-exclusion principle. For two finite sets A and B, we have 

\AUB\ = \A\ + \B\ - \AC\B\. 


To see this, note that when we add A and \B\ , we are counting the elements in \A D B\ twice, thus by subtracting it from \A\ + \B\ , we 
obtain the number of elements in A U B , (you can refer to Figure 1.16 in Problem 2 to see this pictorially). We can extend the same idea to 
three or more sets. 



Generally, for n finite sets A\ , A 2 , A 3 , • • • , A n , we can write 



Example 1.5 

In a party, 

• there are 10 people with white shirts and 8 people with red shirts; 

• 4 people have black shoes and white shirts; 

• 3 people have black shoes and red shirts; 

• the total number of people with white or red shirts or black shoes is 21. 

How many people have black shoes? 

• Solution 

o Let W, R, and B , be the number of people with white shirts, red shirts, and black shoes respectively. Then, here is the summary 
of the available information: 

w\ = 10 

R\ = 8 

whb\ = 4 
RnB\ = 3 
\WUBURl = 21. 
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Also, it is reasonable to assume that W and R are disjoint, 
we obtain 


wnR 


0 . Thus by applying the inclusion-exclusion principle 


WURUB 


21 

W + R + B 


wnR - WHB - RnB + wnRnB 


= 10 + 8 + B - 0 - 4-3 + 0 . 


Thus 



Note that another way to solve this problem is using a Venn diagram as shown in Figure 1.11. 



Fig. 1.11 - Inclusion-exclusion Venn diagram. 


Infinite Sets: 

What if A is an infinite set? It turns out we need to distinguish between two types of infinite sets, where one type is significantly "larger" than 
the other. In particular, one type is called countable, while the other is called uncountable. Sets such as N and Z are called countable, but 
"bigger" sets such as M are called uncountable. The difference between the two types is that you can list the elements of a countable set A, i.e., 
you can write A = {ai, a 2 , • • •}, but you cannot list the elements in an uncountable set. For example, you can write 

. N = {1,2,3, • • •}, 

• Z = {0,1, —1,2, —2,3, —3, • • •}. 

The fact that you can list the elements of a countably infinite set means that the set can be put in one-to-one correspondence with natural 
numbers N. On the other hand, you cannot list the elements in M, so it is an uncountable set. To be precise, here is the definition. 


Definition 1.1 
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Set A is called countable if one of the following is true 

a. if it is a finite set, A < OO ; or 

b. it can be put in one-to-one correspondence with natural numbers N, in which case the set is said to be countably infinite 
A set is called uncountable if it is not countable. 


Here is a simple guideline for deciding whether a set is countable or not. As far as applied probability is concerned, this guideline should be 
sufficient for most cases. 


• N,Z,Q, and any of their subsets are countable. 

• Any set containing an interval on the real line such as a, b] , (a, b\ , [a, b) , or (a, b), where a < b is uncountable 


The above rule is usually sufficient for the purpose of this book. However, to make the argument more concrete, here we provide some useful 
results that help us prove if a set is countable or not. If you are less interested in proofs, you may decide to skip them. 


Theorem 1.3 

Any subset of a countable set is countable. 

Any superset of an uncountable set is uncountable. 

Proof 

The intuition behind this theorem is the following: If a set is countable, then any "smaller" set should also be countable, so a subset of a 
countable set should be countable as well. To provide a proof, we can argue in the following way. 

Let A be a countable set and B C A. If A is a finite set, then B < A < OO, thus B is countable. If A is countably infinite, then we 
can list the elements in A, then by removing the elements in the list that are not in B, we can obtain a list for B, thus B is countable. 

The second part of the theorem can be proved using the first part. Assume B is uncountable. If B C A and A is countable, by the first part 
of the theorem B is also a countable set which is a contradiction. 


Theorem 1.4 

If Ai , A2 , • • • is a list of countable sets, then the set U At = Ai U A 2 U A3 • • • is also countable. 

Proof 

It suffices to create a list of elements in U Ai . Since each A{ is countable we can list its elements: A{ — {dill * • •}• Thus, we have 

• Ai = {an, ai2, • * *}, 

• A 2 = {a 2 i,a 2 2, • * •}, 

• A 3 = {a 3 i,a 32 , • • •}, 

• 

Now we need to make a list that contains all the above lists. This can be done in different ways. One way to do this is to use the ordering 
shown in Figure 1.12 to make a list. Here, we can write 

(1.1) 
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ftn —^ di2 fti3 —y a 14 

z z z z 

0-21 d22 ft23 ft 24 

1 Z Z Z 

ft31 ft32 ft33 ft 34 

Z Z 

ft41 ft42 ft43 ft44 

1 Z 

ft-51 ft52 ft53 ft 54 


Fig. 1.12 - Ordering to make a list. 

We have been able to create a list that contains all the elements in U Ai , so this set is countable. 

Theorem 1.5 

If A and B are countable, then A X B is also countable. 

Proof 

The proof of this theorem is very similar to the previous theorem. Since A and B are countable, we can write 

A = {ai, < 22 , ft 3 , • * •}, 

B = {&i, 62 , 63 ,•*•}• 

Now, we create a list containing all elements in A X B = {(a^, bj)\i,j — 1,2,3,***}- The idea is exactly the same as before. Figure 
1.13 shows one possible ordering. 
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(01,62) 


(oi, 63) -> 

(01,64) 




T 1 



{ a , 2 , bi ) 


(02,62) 


(02,63) 

(02,64) 

i 








(03,62) 


(03,63) 

(03,64) 







( a 4 , bi ) 


(04,62) 


(04,63) 

(04,64) 


w 

m 

m 

Fig. 1.13 - Ordering to make a list. 


The above arguments can be repeated for any set C in the form of 

G = UUKf 


* 3 

where indices i and j belong to some countable sets. Thus, any set in this form is countable. For example, a consequence of this is that the set 
of rational numbers 0 is countable. This is because we can write 


= UIK0 


ieZje N 


J 


The above theorems confirm that sets such as N, Z, Q and their subsets are countable. However, as we mentioned, intervals in R are 
uncountable. Thus, you can never provide a list in the form of {ai, <22, &3, • * *} that contains all the elements in, say, [ 0 , 1 . This fact can be 
proved using a so-called diagonal argument, and we omit the proof here as it is not instrumental for the rest of the book. 


<— previous 
next —► 
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